ATTACHMENT B 



Randy Beckers 

Staas & Halsey 

700 Eleventh Street N.W. 

Washington, DC 

20001 " 

Dear Randy, 

Thanks for your time on the phone today. As I mentioned, here is our first 

blush at moving this proposal along. This is our first shot so we expect good 

guidance and maybe a few tsk tsks from you as part of this process. We 

would like to get: 

- a go/no go indication from you 

-for the future, some style points as to our process 

-outline for us the next steps for this application, if it is a go 

-parallel costing for moving this ahead in a 1 month scenario and a 6 week 

scenario 



With regards to this application, I took a few notes in our meeting this 
morning that may be germane to your review: 
-one cannot get a patent on marking menus alone 

-this feature is scheduled to be in our next version of the software to be 
shown at Siggraph in July/August of this year 

-we will flesh out (if not already done in this package to you) the references 
to other similar or related invention proposals, publications or commercial 
products 

-we intend to help your search process out by providing an index of keywords 

Please let us know if there are other things we should take into 
consideration. I look forward to your reply. 

Yours Truly — 




Invention Proposal 



Inventor 

Gordon Kurtenbach 
Descriptive Title 

A Combination of Marking Menus and Linear Menus 

A brief summary of the invention, indicate the feature which are new. 

Marking menus is a pop up menu technology that displays menu items in a circle, around the cursor 
whereas traditional menus display menu items in a linear fashion, for example, from top to bottom. 
Because of this difference, item selection can be performed more rapidly with marking menus than with 
linear menus. For example, a user can select from marking menus by "flicking" the cursor in the 
direction of a desired menu item. Thus the user does not have to wait for the menu to be displayed to 
select from it. However, as the number of items in a marking menus increases, rapid selection without 
popping up the menu becomes difficult because the angular difference between menu items becomes 
small and difficult for the user to articulate. To combat this problem, the number of items in a marking 
menus is generally limited to eight or less. We propose an invention which combines marking menus 
and linear menus in the same display such that the number of items can be increased beyond eight items 
while still permitting rapid selection for the first eight items in the menu. This invention makes the 
replacement of traditional linear menus with marking menus much more simple. 

A more detailed description of the invention, including advantages, the problems solved by the 
invention, and how each problem is solved. Indicate the current methods used to solve the problems and 
the deficiences of these methods. Include sketches, drawings, notebook pages, memos, or photos as 
appropiate. 

Introduction 

Menus selection in modern user interfaces is a fundamental and frequently used operation. In general, 
the length of time it takes to select from a menu is small (seconds or fractions of second). However, 
because menu selection is high frequency operation, reducing the time involved in selecting from a 
menu can result in significant time savings in the overall time it takes to accomplish a larger task. It is 
for this very reason that menu selection speed up ("accelerator 11 ) techniques like "hot keys" and marking 
menus (Kurtenbach & Buxton, 1991) are popular. 

Each accelerator technique has its own advantages and disadvantages. For example, hot keys can select 
from a large set of menu items, for example, every key on the keyboard can be used as hot key. 
However, this is at the cost of the user remembering the associations between menu items and keys. Hot 
keys are also not effective if a user is working on keyboardless system or the user must move between 
the keyboard and another device while operating the interface (for example, the user may have to move 
the same hand from the mouse, to the keyboard, and then back to mouse). 

Marking is another menu selection acceleration which works as follows. A user presses down on the 
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screen with the pen and waits for a short interval of time (approximately 1/3 second). A radial menu 
then appears directly under the tip of the pen. A user then highlights an item by keeping the pen pressed 
and making a stroke towards the desired item. If the item has no sub-menu, the item can be selected by 
lifting the pen. If the item does have a sub-menu, it is displayed. The user then continues, selecting from 
the newly displayed sub-menu. Figure 1 (a) shows an example* Lifting the pen will cause the current 
series of highlighted items to be selected. The menus are then removed from the screen. At any time a 
user can indicate "no selection" by moving the pen back to the center of the menu before lifting, or 
change the selection by moving the pen to highlight another item before lifting. Finally a user can 
"back-up" to a previous menu by pointing to its center. 

The other, faster, way to make a selection without popping up the menu is by drawing a mark. A mark 
can be drawn by pressing the pen down and immediately moving. The shape of the mark dictates the 
particular series of items selected from the menu hierarchy. Figure 1 (b) shows an example. 
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Figure 1, Marking Menus allow an items to be selected in two different ways. Using method (a), radial 
menus can be sequentially displayed and selections made. Method (b) uses a marking to make the same 
selection. Method (a) is good when the user is unfamiliar with the menu. Method (b) is good when the 
user is familiar with the menu and wants to avoid waiting for the display of each menu. 

Marking menus avoid some of the problems of hot keys. A user does not have to remember association 
between keys and menu items: they only need to remember the spatial layout of menu items. We have 
found that users very quickly learn the spatial location of menu items, especially for frequently used 
commands. Marking menus also do not require a keyboard for operation. However, because human 
capability is limited in the accuracy in which angles can drawn, the number of menu items in marking 
menus is generally limited to eight items. 



The problem is that in many situations modern user interfaces use menu with more than eight items. For 
example, the number of items in pop-up menus in Alias v6 ranges from 8 to 15 items, with an average of 
12.75 items per pop-menu. Higher number of items can be used in marking menus by making the menus 
hierarchic. In this case rapid menu selection require a zig-zag line rather than just a simple stroke. For 



example, a 64 item menu can be made up of an eight item menu were each item leads to another eight 
item submenu. Thus if a UI designer wishes to convert an application which uses linear menus to one 
which uses marking menus, the designer must convert any menu that takes more than eight items into an 
hierarchic menu. This conversion process requires extra work and linear menu items may not 
decompose naturally into hierarchic categories. 

The invention is variation on the marking menu design which combines marking menus and linear 
menus such that converting linear menus into marking menu does not require the decomposition of 
menu items into categories. In the invention the first eight items of the linear menu are mapped directly 
to marking menu. The addition (the "overflow" items) are mapped to a linear menu, which is display at 
the same time the marking menu is displayed. Figure 2 shows the invention. Figure 3 shows how a 
fourteen linear item menu is converted to the technique. 
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Figure 2. The invention combines a marking menu and linear menu in the same pop-up menu display. 

This invention has the following advantages. First, as stated before conversion of linear menus this 
format is simple: no decomposition into hierarchic categories is needed and more that eight item per 
menu can be used. Second, accelerated selection can be performed on the first eight items in the menu 
(by drawing a mark at an angle). If the eight most frequently used items in a menu are placed in these 
first eight menu items, time saving can be realized over traditional linear menus. Third, because some of 
the items in the menu are laid out side by side as opposed to top to bottom, the overlali height of menu is 
reduced. Finally, this type of menu takes up the same type screen space as tradition iinear menus and 
therefore this new menu can be displayed at the same location as tradition linear menus (for example, 
the menu can be pop-up or pop-down etc). 
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Figure 3. How a fourteen item linear menu can be converted to the invention. 

The invention has the following disadvantages relative to traditional linear menus. First, the user must 
pause to display the menu before selecting an item from the linear portion of the menu. This should not 
be a great disadvantage since these items are by definition supposed to be infrequenctly used commands. 
If the position where the menu pops-up is very close the edge of screen there may not be enought room 
to select some of items from the radial portion of menu using flick. For example, suppose the menu pops 
up when a user presses the mouse button down right in the top left corner of the screen. At this point 
there is no room to "flick" the cursor up or to the left to select some of the menu items. In practice, this 
is not serious problems since there are very few sitution where menu is popped up right along the edge 
of the screen. Also, the amount of room needed for a flick can be very small. Finally, the radial portion 
of menu represent a grouping of menu items that is based on frequency of selection. In linear menus, 
items are generally grouped together based on function. Therefore, the conversion to this new menu 
system might require minor rearrangement of items in a menu. Fortunately, studies indicate that 
grouping menu items has little value once user become familiar with a menu layout and therefore this 
disadvantage would not be a serious problem in the long run. 

Names of other know to have worked on this or similar invention: 



none 



Identify any know similar, or related Invention Proposals, patents or publications, Alias or non-Alias 
commercial products. 

Radial menus, linear menus and marking menus have been disciosed previous in publications. 

Has the invention been built and/or tested? 

Yes. 

Is the invention used in a current product or planned for use in a future product? 

Marking menus are used in StudioPaint V2, We intend to use the invention in future Alias products. 

Indicate the. dates of any previous or planned future disclosure external to Alias and identify the type of 
disclosure (by agreement , demonstration, paper, or presentation, market probe, published article, etc. If 
convenient, please provide a copy of the agreement, paper or article): 

None planned, 

Source of outside funding for the invention, if any: 
None 
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To; Alias Legal Department 
Alias Research Inc. 
110 Richmond St, East 
Toronto, Ontario 
M5C 1P1 



1 


Proposal Submitted By (Please use legal name) Full First Name, 
Middle, Last 


Extension No. 


2 


Proposal Submitted By (Please use legal name) Full First Name, 
Middle, Last 


Extension No. 


*3 


Proposal Submitted By (Please use lega! name} Full First Name, 
Middle, Last 


Extension No. 



*lf space for additional submitters is required, please use another sheet; and attach any supplementary 
comments 



Manager 



Extension No. 



Name of Alias Program & Technology 



Descriptive Title of Proposal: 



Provide a brief summary or abstract of the invention, specifically pointing out the features you think are 
new: 



Provide here, using added pages, a more detailed technicaf description of your invention, including the 
advantage(s), and the probiem(s) solved by the invention, and how each \s accomplished. Please 
indicate the current methods or techniques used to solve the probiem(s), and the deficiencies of these 
methods or techniques. Sketches, drawings, notebook pages, memos, or photos can be very helpful and 
should be attached if possible: 



EACH PAGE, INCLUDING ATTACHMENTS, SHOULD BE SIGNED, WITNESSED AND 
DATED AS BELOW. 



Witnessed and Understood By: 


Date 


Submitters) Signature(s): 


Date 



ALIAS Invention Proposal 
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Witnessed and Understood By; Date 
Submitters) Signature(s): Date 



ALIAS Invention Proposal 



Confidential 



Names of others known to have worked on this or a similar invention: 



Idenntify any known similar, or related Invention Proposals, patents or publications, Alias or non-Alias 
commercial products, or indicate none: 



Has a model, a prototype, or experiment of the invention been built, made, run or tested? Yes No 



Is the invention used in a current product(s) or planned for use m a future product(s)? Yes No 
If so, please identify the program(s) or product(s), and introduction dates: 



Indicate the date(s) of any previous or planned future disclosure external to Alias, (has the invention 
been disclosed, or is it planned for disclosure outside of Alias) and identify the type of disclosure (by 
agreement, demonstration, paper or presentation given, market probe, published article, etc., and if 
convenient, please provide a copy of the agreement, paper or article): 



Source of outside funding, if any: 



Witnessed and Understood Sy: 


Date 


Submitter(s) Signature(s): 


Date 
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MANAGER'S COMMENT FORM 

SdDrnlttef^; 

Title of invention: 

CornmertBBy: Date: 

Manager 



1. 


Problem addressed or function provided by the invention: 


2. 


Central thrust of the invention: 


3. 


Could invention have impact beyond current description?: 


4. Potential for Alias application. Specify product or technology program if possible: 


5. 


Value to competitors; potential for license or trade: 


6. 


Please indicate any related patents, publications, or activities you know of: 


7 


I would recommend the following form(s) of protection: 

Patent Defense publication Keep trade secret None 
Comments: 



Alias Invention Proposal 

Inventor 

Gordon Kurtenbach 

Descriptive Title 

A Combination of Marking Menus and Linear Menus 

A brief summary of the invention. Indicate the feature which are new. 

Marking menus is a pop up menu technology that displays menu 
items in a circle, around the cursor whereas traditional menus 
display menu items in a linear fashion, for example, from top to 
bottom. Because of this difference, item selection can be performed 
more rapidly with marking menus than with linear menus. For 
example, a user can select from marking menus by "flicking" the 
cursor in the direction of a desired menu item* Thus the user does 
not have to wait for the menu to be displayed to select from it. 
However, as the number of items in a marking menus increases, 
rapid selection without popping up the menu becomes difficult 
because the angular difference between menu items becomes small 
and difficult for the user to articulate. To combat this problem, the 
number of items in a marking menus is generally limited to eight or 
less. 

We propose an invention which combines marking menus and linear 
menus in the same display such that the number of items can be 
increased beyond eight items while still permitting rapid selection 
for the first eight items in the menu. This invention makes the 
replacement of traditional linear menus with marking menus much 
more simple. 

A more detailed description of the invention, including advantages, the 
problems solved by the invention, and how each problem is solved. Indicate 
the current methods used to solve the problems and the deficiences of these 
methods. Include sketches, drawings, notebook pages, memos, or photos as 
appropiate. 

Menus selection in modern user interfaces is a fundamental and 
frequently used operation. In general, the length of time it takes to 
select from a menu is small (seconds or fractions of second). 
However, because menu selection is high frequency operation, 
reducing the time involved in selecting from a menu can result in 
significant time savings in the overall time it takes to accomplish a 



larger task. It is for this very reason that menu selection speed up 
("accelerator") techniques like "hot keys" and marking menus 
(Kurtenbach & Buxton, 1991) are popular. 

Each accelerator technique has its own advantages and 
disadvantages. For example, hot keys can select from a large set of 
menu items, for example, every key on the keyboard can be used as 
hot key. However, this is at the cost of the user remembering the 
associations between menu items and keys. Hot keys are also not 
effective if a user is working on keyboardless system or the user 
must move between the keyboard and another device while 
operating the interface (for example, the user may have to move the 
same hand from the mouse, to the keyboard, and then back to 
mouse). 

Marking is another menu selection acceleration which works as 
follows. A user presses down on the screen with the pen and waits 
for a short interval of time (approximately 1/3 second). A radial 
menu then appears directly under the tip of the pen. A user then 
highlights an item by keeping the pen pressed and making a stroke 
towards the desired item. If the item has no sub-menu, the item can 
be selected by lifting the pen. If the item does have a sub-menu, it 
is displayed. The user then continues, selecting from the newly 
displayed sub-menu. Figure 1 (a) shows an example. Lifting the pen 
will cause the current series of highlighted items to be selected. The 
menus are then removed from the screen. At any time a user can 
indicate "no selection" by moving the pen back to the center of the 
menu before lifting, or change the selection by moving the pen to 
highlight another item before lifting. Finally a user can "back-up" to 
a previous menu by pointing to its center. 

The other, faster, way to make a selection without popping up the 
menu is by drawing a mark. A mark can be drawn by pressing the 
pen down and immediately moving. The shape of the mark dictates 
the particular series of items selected from the menu hierarchy. 
Figure 1 (b) shows an example. 
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Figure 1. Marking Menus allow an items to be selected in two different ways. 
Using method (a), radial menus can be sequentially displayed and selections 
made. Method (b) uses a marking to make the same selection, Method (a) is 
good when the user is unfamiliar with the menu. Method (b) is good when the 
user is familiar with the menu and wants to avoid waiting for the display of each 
menu. 

Marking menus avoid some of the problems of hot keys. A user does 
not have to remember association between keys and menu items: 
they only need to remember the spatial layout of menu items. We 
have found that users very quickly learn the spatial location of menu 
items, especially for frequently used commands. Marking menus 
also do not require a keyboard for operation. However, because 
human capability is limited in the accuracy in which angles can 
drawn, the number of menu items in marking menus is generally 
limited to eight items. 

The problem is that in many situations modern user interfaces use 
menu with more than eight items. For example, the number of items 
in pop-up menus in Alias v6 ranges from 8 to 15 items, with an 
average of 12.75 items per pop-menu. Higher number of items can 
be used in marking menus by making the menus hierarchic. In this 
case rapid menu selection require a zig-zag line rather than just a 
simple stroke. For example, a 64 item menu can be made up of an 
eight item menu were each item leads to another eight item 
submenu. Thus if a UI designer wishes to convert an application 
which uses linear menus to one which uses marking menus, the 
designer must convert any menu that takes more than eight items 
into an hierarchic menu. This conversion process requires extra 



work and linear menu items may not decompose naturally into 
hierarchic categories . 

The invention is variation on the marking menu design which 
combines marking menus and linear menus such that converting 
linear menus into marking menu does not require the decomposition 
of menu items into categories. In the invention the first eight items 
of the linear menu are mapped directly to marking menu. The 
addition (the "overflow" items) are mapped to a linear menu, which 
is display at the same time the marking menu is displayed. Figure 2 
shows the invention. Figure 3 shows how a fourteen linear item 
menu is converted to the technique. 




Figure 2. The invention combines a marking menu and iinear menu in the same 
pop-up menu display. 

This invention has the following advantages. First, as stated before 
conversion of linear menus this format is simple: no decomposition 
into hierarchic categories is needed and more that eight item per 
menu can be used. Second, accelerated selection can be performed 
on the first eight items in the menu (by drawing a mark at an angle). 
If the eight most frequently used items in a menu are placed in these 
first eight menu items, time saving can be realized over traditional 
linear menus. Third, because some of the items in the menu are laid 



out side by side as opposed to top to bottom, the overfall height of 
menu is reduced. Finally, this type of menu takes up the same type 
screen space as tradition linear menus and therefore this new menu 
can be displayed at the same location as tradition linear menus (for 
example, the menu can be pop-up or pop-down etc.). 




Figure 3. How a fourteen item linear menu can be converted to the invention. 

The invention has the following disadvantages relative to traditional 
linear menus. First, the user must pause to display the menu before 
selecting an item from the linear portion of the menu. This should 
not be a great disadvantage since these items are by definition 
supposed to be infrequenctly used commands. If the position where 
the menu pops-up is very close the edge of screen there may not be 
enought room to select some of items from the radial portion of 
menu using flick. For example, suppose the menu pops up when a 
user presses the mouse button down right in the top left corner of 
the screen. At this point there is no room to "flick" the cursor up or 
to the left to select some of the menu items. In practice, this is not 
serious problems since there are very few sitution where menu is 
popped up right along the edge of the screen. Also, the amount of 
room needed for a flick can be very small. Finally, the radial portion 
of menu represent a grouping of menu items that is based on 
frequency of selection. In linear menus, items are generally grouped 
together based on function. Therefore, the conversion to this new 
menu system might require minor rearrangement of items in a 



menu. Fortunately, studies indicate that grouping menu items has 
little value once user become familiar with a menu layout and 
therefore this disadvantage would not be a serious problem in the 
long run. 

Names of other know to have worked on this or similar invention: 
None 

Identify any know similar, or related Invention Proposals, patents or 
publications, Alias or non- Alias commercial products. 

Radial menus, linear menus and marking menus have been disclosed 
previous in publications. 

Has the invention been built and/or tested? 
Yes. 

Is the invention used in a current product or planned for use in a future 
product? 

Marking menus are used in StudioPaint V2. We intend to use the 
invention in future Alias products. 

Indicate the dates of any previous or planned future disclosure external to 
Alias and identify the type of disclosure (by agreement, demonstration, paper, 
or presentation, market probe, published article, etc* If convenient, please 
provide a copy of the agreement, paper or article): 

None planned. 

Source of outside funding for the invention, if any: 

None 

Keywords: 

Pie menus, radial menus, marking menus, gestures, pop-up menus, 

References: 

See attached papers 



